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Abstract 

The star height hierarchy (resp. the variable hierarchy) results in classifying /i-terms into classes 
according to the nested depth of fixed point operators (resp. to the number of bound variables). We 
prove, under some assumptions, that the variable hierarchy is a proper refinement of the star height 
hierarchy. We mean that the non collapse of the variable hierarchy implies the non collapse of the 
] star height hierarchy. The proof relies on the combinatorial characterization of the two hierarchies 
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^ ! 1 Introduction 

I Roughly speaking, a /i-calculus in the abstract sense of Arnold and Niwihski [T, §2] is a set of syntactic 

' entities and a set of formal operations. The latter consists in the fixed point operators and v and the 

substitution operation. These syntactic entities come with and intended interpretation over a class of 
' complete lattices. Each entity t is interpreted as a monotonic mapping from to L, where ar{t) is 

b : 

^ the arity of t, that corresponds to the free variables of t, and L is a complete lattice. The entities ^ix.t 

and vx.t of a /^-calculus are interpreted respectively as the least and greatest parametrized fixed point 
of the interpretation of t. The substitution is interpreted by means of the functional composition. 

Hierarchies and logical expressiveness are at the core of fixed point theory. The most known and 
well studied measure of the complexity of the /i-calculi is the alternation depth of its /i-terms |121 151 [2] , 
that is, the number of alternations between fi and i^. As a consequence, it is possible to construct a 
hierarchy of /i-terms according to the alternation depth measure. The variable hierarchy [SI 0] results 
in classifying /i-terms into classes according to the number of bound variables i.e. fixed point variables. 
By introducing the variable hierarchy for the propositional modal /i-calculus ^11 and showing that 
it does not collapse [B], the authors managed to separate Parikh's Game Logic [13] from the modal 
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/1-calculus and solve a long standing open problem. 

The third hierarchy is the star height hierarchy [101 [S] : the /i-terms are classified into levels of a 
hierarchy according to the nested depth of the application of fixed point operators (or the iteration 
operator) . The star height problem was first asked in formal language theory and consists in answering 
whether all regular languages can be expressed using regular expressions of bounded star height. This 
question have been answered by Eggan in [10\, where he gave examples of regular languages of star 
height n for every n G N. The star height problem was asked later for regular trees [9], the latter are 
finite or infinite trees with only finite many distinct subtrees, up to isomorphism. Regular trees form 
the free iteration theory and they might be written by means of iterative theory expressions. These 
expressions use an iteration operator, denoted f , which is interdefinable with the Kleene's * operator 
in the case of matrix iteration theories [7l §9]. The star height problem can be asked in a general way 
for iteration theories [7], where the dagger f operator is considered. 

The alternation depth hierarchy and the variable hierarchy are orthogonal, however the variable 
hierarchy and the star height hierarchy are intuitively close. In this paper we show that the variable 
hierarchy is a proper refinement of the star height hierarchy. That is, the non collapse of the former 
implies the non collapse of the latter. The key observation is that the combinatorial measure which 
characterizes the variable hierarchy (i.e. the entanglement) is lower than the combinatorial measure 
which characterizes the star height hierarchy (i.e. the rank). 

Preliminaries and Notations 

A digraph G ~ {Vg,Eg) is a set of vertices Vq and a binary relation Eg C x Vg- G is strongly 
connected if for each two vertices vi,V2 € Vg there exists a path in G from vi to . A strongly connected 
component of G is a maximal strongly connected subgraph of G. We shall write scc(v) for the strongly 
connected component of G that contains the vertex v. A strongly connected component is trivial if it 
reduces to a single vertex without loops. We shall write SCG{G) for the set of the non trivial strongly 
connected components of G. We define a transitive relation -<g on SCC{G) as follows: Gi <g G2 if 
and only if Gi ^ G2 and there is a path in G from a vertex of Gi to a vertex of G2. If Gi G SGG{G) 
then let Gj" = { G2 G SCG{G) \ Gi <g G2 }■ If no confusion will arise then we shall write -< instead 
of ^G- 
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2 The //-calculi: syntax and semantics 

We recall the definition of a /i-calculus as given in [11 §2]. Let i? be a set of objects or entities and 
let Var be a fixed countable set of variables. The variables in Var will be denoted by x, y, z, . . . A 
mapping p : Var E is called a substitution. If p is a substitution into some set E, x a variable, and 
e and element of i?, we denote by p{e/x} the substitution p' defined by p'{x) = e and p'{y) — p{y) 
if y ^ X. More generally, if distinct variables and if ei, . . . , e„ are elements of E, then 

p{ ei/xi, . . . , e„/a;„ } is the substitution p' defined by 



Definition 2.1. A p-calculus is a tuple {T,id,ar,comp, p,!/), where 

• T is an arbitrary set, its elements are the /i-terms of the p-calculus. 

• id is a mapping from Var to T. We denote by x the element id{x) in T. 

• ar is a mapping associating to each t eT a subset of Var called the arity oft. If x E ar{t), we 
say that x occurs free in t, and the elements of ar{t) are called the free variables oft. 

• comp is a mapping associating a p-term comp(t, p) with any p-term t and any substitution p; we 
shall write also t[p]. 

• p and V are two mappings from Var x T to T , the value of the mapping 9 on x and t is written 
Ox.t, for 6 — p,v. 

Moreover, a /i-calculus should satisfy further axioms, see [U §2]. 

Semantics Let {T,id,ar,comp, p,!/) be a /i-calculus. A p- interpretation of T is a pair {L,I) where 
L is a complete lattice and / is a function that associates to each p-teim t a monotonic mapping 
t : L such that the substitution is interpreted as the functional composition and px.t (resp. 

vx.t) is interpreted as the least (resp. greatest) parametrized fixed point of the interpretation of t. 

Many syntactic entities can be structured to have a shape of a /i-calculus. For instance, this happened 
to infinite words [1] §5], automata [TJ §7], and parity games [14] . The interpretation of an automaton, 
viewed as an entity of the /i-calculus, is the language which it accepts. 
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3 The star height hierarchy 

Definition 3.1. Let t he a fi-term and Compo be the set if ii-terms without application of fixed point 
operators pL and v. The star height oft is defined as follows: 



The rank : a digraph measure for the star height 

In [lOj Eggan defined a complexity measure of digraphs, called the feed back number, that captures the 
minimal star height of regular languages. The minimal star height of a regular language is exactly the 
feed back number of the minimal digraph of the expressions defining this language. This measure has 
been formulated in a more natural way by Courcelle et al. in [9^, and they rename it the rank. There, 
they solved the star height problem for regular trees, and showed that the minimal star height of a 
regular tree is exactly the rank of the minimal digraph of the tree. 

Definition 3.2. The rank of a digraph G is defined as follows: 

• ifSCC{G) = 0, then r{G) = 0, 

• if SCG{G) = {G], then r{G) = 1 + Min{ r{G\v)\vG Vg) }, 

• otherwise, r{G) = Max{r{G') \ G' e SCC{G) }. 

Note that r{G) = if G is acyclic. If G is strongly connected and r{G) = 1 then G contains a vertex 
whose removal makes the digraph acyclic. It is not hard to argue that the rank of an undirected path 
on n vertices is \ log{n)\. 

Thief and Cops games for the rank 

To establish the relation between the rank and the entanglement, in a first step, we rephrase the 
definition of the rank in terms of games and strategies in the most direct way. 

Definition 3.3. The rank game M{G, fc), fc > played alternatively between a Thief and Cops on the 
digraph G is defined as follows. 

• Its positions are of the form {G',P,n) where < n < k, G' is a subgraph of G, and P e 
{ Thief, Gaps } such that 

— the starting position is {G, Thief ,k), 







if t £ Compo 



h{t) = < 



Adax{h{t'),h{p{xi)), . . . ,h{p{xn))} if t = comp{t' , p) where Xi £ ar{t') 
1 + h(t') if t = Ox.t' where 9 = 



if SGGiG) = or n — Q then the play halts. 
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• // SCC{G) = { Gi, . . . , G; }, (possibly I — 1) then Thief chooses some Gi and moves from 
(G, Thief ,n) to {Gi,Gops,n). 



• // the position is (G, Gaps, n) thev^ Cops choose v G and move to (G \ v, Thief, n — 1), 

• Thief wins a play if and only if its /ina^ position (G', P, n) is such that SGG{G) ^ and n = 0. 
We define ^(G) to be the minimum k such that Cops have a winning strategy in the rank game M{G, k). 
Proposition 3.4. Let G be a digraph, then ^%{G) equals r{G). 

Proof. We have just rephrased the definition of the rank by means of games and strategies fohowing 
the game theoretic tradition. That is, Cops play the role of the minimizer and Thief plays the role of 
the maximizer. □ 

Now, in order to compare the rank with the entanglement in an easy way, we shall give a useful 
variant of the rank games. The idea is that, whenever SCC{G) = { Gi, . . . , G; } and Thief moves from 
(G, Thief, n) to {Gi, Gaps, n), for some i £ {1, . . . ,1}, then he is allowed later, and at any moment, to 
come back and move to {Gj, Cops, n) where Gi, Gj € SCC{G) and Gi -< Gj. 

Definition 3.5. Let G be a digraph and fc > 0. We define the rank game with come back ^^{G, k) 
between Thief and Cops on the digraph G as follows: 

Its positions are of the form (G', P, L, n) where < ti < fc, G' is a subgraph of G, P G { Thief, Cops }, 
and L is a set of quadruplet of the form (G, P, L, n) such that 

• the starting position is {G, Thief ,^,k), 

• if (5GG(G) = or n = 0) and L = then the play halts. 

If SCC{G) = { Gi, . . . , G/ }, (possibly I = 1) then Thief has two kinds of moves: 

• he chooses some d G SCC{G) and moves from 

(G, Thief, L, n) {d. Cops, G^ x {Cops, L, n) U L, n) (forward move) 

where { Gi, . . . , G/ } x {Cops,L,n) ^def { {Gi,Cops, L,n),. .., {Gi,Cops, L,n) }. 

• or he moves from 

(G', Thief, L,n) ^ B where B £ L (come back move) 



^Observe that in this case G is strongly connected. 
"^Observe that there is no infinite play. 
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If the position is (G, Cops, n) therjfl Cops choose u S Vg and move to {G\v, Thief, n — 1), 

Thief wins a play if and only if its final position (G", P, n) is such that SCC{G) ^ and n = 0. 

We define ^^(G) to be the minimum k such that Cops have a winning strategy in the rank game 
i^^(G,fc). 

Fact 3.6. There is no infinite play in the game ^^{G,k). 

Lemma 3.7. Let G be a digraph, then Thief has a winning strategy in {G, k) if and only if he has 
a winning strategy in Sl(G, k). Therefore r{G) — M{G) — ^,^{G). 

Proof. First, if Thief has a winning strategy in ^(G, k) then he also has a winning strategy in M^{G, k) 
i.e. the latter being without using come back moves. 

Second, if Thief has a winning strategy in ^^{G,k) which uses a come back move of the form 
(G', Thief, L,n) ^ B then he was able to move early to B. □ 



4 The variable hierarchy 

In order to compute the minimum number of bound (i.e. fixed point) variables needed in a /i-term up 
to ck-conversion, a digraph measure is required, that is the entanglement. The entanglement of a finite 
digraph G, denoted S'{G), was defined in [5] by means of some games S'{G,k), k = 0, . . . , |Vg|. The 
game S'{G, k) is played on G by Thief against Cops, a team of k cops as follows. Initially all the cops 
are placed outside the digraph. Thief selects and occupies an initial vertex of G. After Thief's move. 
Cops may do nothing, may place a cop from outside the digraph onto the vertex currently occupied 
by Thief, may move a cop already on the graph to the current vertex. In turn Thief must choose an 
edge outgoing from the current vertex whose target is not already occupied by some cop and move 
there. If no such edge exists, then Thief is caught and Cops win. Thief wins if he is never caught. The 
entanglement of G is the least k ^ N such that k cops have a strategy to catch the thief on G. It will 
be useful to formalize these notions. 

Definition 4.1. The entanglement game (o{G, k) of a digraph G is defined by: 

• Its positions are of the form [v, C, P), where v S Vg, C C Vg and |G| < k, P E {Cops, Thief}. 

• Initially Thief chooses vq G Vg and moves to (vo,9,Cops). 

• Cops can move from {v,C,Cops) to {v, C , Thief) where C can be 
■^Observe that in this case G is strongly connected. 



6 



— C : Cops skip, 

— C U { f } ; Cops add a new Cop on the current position, 

— (C\{x})U{u} ; Cops move a placed Cop to the current position. 

• Thief can move from {v, C, Thief) to (f ', C, Cops) if (w, v') £ Eq and v' ^ C . 

Every finite play is a win for Cops, and every infinite play is a win for Thief. 

<^{G), the entanglement of G, is the minimum k G {0, ...,|Vg|} such that Cops have a winning 
strategy in S{G, k). 

Observe that an undirected path has entanglement at most 2. The following Proposition, see [31 §3.4], 
provides a useful variant of entanglement games. 

Proposition 4.2. Let (^{G, k) he the game played as the game S{G, k) apart that Cops are allowed to 
retire a number of cops placed on the digraph. That is. Cops moves are of the form 

• {g,C,Cops) — » {g, C' , Thief) (generalized skip move), 

• {g, G, Cops) {g,C' U {g }, Thief) (generalized replace move), 

where in both cases G' C G. Then Cops have a winning strategy in S{G, k) if and only if they have a 
winning strategy in SiG, k). 

4.1 An ad hoc variant of entanglement games 

The game theoretic definition of the entanglement. Definition 14. II and even the variant given in Propo- 
sition 14.21 refers to some rules which are not very close to the rules of the rank games with come back 
which characterize the rank. Definition 13.51 And hence we can not establish the relation between the 
rank and the entanglement in an easy way. Therefore we shall give an equivalent variant of entangle- 
ment games, denoted (f^(G, fc), with the property that its rules are close to those of the rank games. 
First we explain informally the new features of this game w.r.t the games for entanglement. In the game 
{G, k) Cops are allowed to skip, add a cop, replace a cop, retire a number of cops, and moreover we 
would like that they can put a cop on a vertex situated anywhere in the digraph. However, the latter 
move is not allowed by entanglement rules. In order to make it possible. Cops should keep in reserve a 
set Vir of virtual cops for this purpose: whenever Cops decide to put a cop on an arbitrary vertex w 
then they should reserve a cop for this purpose and this cop can not be used until Thief visits vertex 
w. And at this moment, the virtual cop must be placed on w. 
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Definition 4.3. The game (G, k) is defined as the entanglement game (?{G, k) apart that its posi- 
tions are of the form {v, C, Vir, P) where Vir C Vq and \C U Vir\ < k. Besides the old Cops' move^, 
the latter act on the set C , Cops can move from [v, C, Vir, Cops) to (v, C , Vir' , Thief) such that: 

• if V € Vir then Cops must update C — C U {v} and Vir' — Vir \ {v}, 

• if V ^ Vir then Cops may update Vir' — (Vir \A)U{w} where w ^Vq and A C Vir. 

Lemma 4.4. Let G be a digraph. Cops have a winning strategy in S'^ (G, k) if and only if they have a 
winning strategy in S'{G, k). 

Proof. First, a winning strategy for Cops in S'{G,k) is still winning for them in S'^{G,k), the latter 
does not refer to virtual cops. In This case every position {v,C,Vir, P) in S'^{G,k) is matched with 
the position {v, C, P) in S'{G, k) where Vir — 0. 

Second, a Cops' winning strategy in S'^{G,k) is mapped to a Cops' winning strategy in S'{G,k) as 
follows. Every position {v, C, P) of S'{G, k) is matched with the position (w, C, Vir, P) of [G, k). 
A Thief's move from v to v' in S'{G, k) is simulated by the same move from v to v' in S'^ {G, k). Indeed 
this simulation is possible because Thief is allowed in S'^ {G, k) to cross a vertex which is occupied by 
a virtual cop. 

Assume that the position (w, C, Cops) is matched with the position (u, C, Vir, Cops) and consider a 
Cop's move M = {v,C, Vir, Cops) — > {v,C' , Vir' , Thief) in <S^{G,k). The move M is simulated in 
S{G, k) by the move [v, C, Cops) ^ [v, C' , Thief). □ 



5 The star height hierarchy vs. the variable hierarchy 

We are ready to state the main result of this paper. 

Theorem 5.1. Let G be a digraph. The entanglement of G is lower or equal to the rank of G. 

Proof. To prove that S'{G) < r{G) it is enough to prove {G) < ^%^{G). Because Lemma [4.41 shows 
that S{G) = S'^iG) and Lemma [3J] shows that r(G) = M^{G). Let k = <S'^{G), we shaU construct a 
winning strategy for Cops in the game S'^ {G, k) out of a Cops' winning strategy in ^^{G, k). 
Every position of the form {v, C, Vir, P) in (#^(G, k) is matched with a position of the form (G", P, L, n) 
in ^^{G, k) such that if the strongly connected component of the subgraph G\{CVJVir) which contains 
V, denoted by scc{v), is not trivial then scc{v) = G' . 
* Which are the skip, the add and the generalized replace. 
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Let us consider a Thief's move in S'^ {G, k) of the form M = (u, C, Vir, Thief) {w, C, Vir, Cops). 
If scc{w) is trivial, then Cops just skip in (G, k). Observe that either Thief wiU reach a vertex without 
successors (where he loses), or he enters a non trivial strongly connected component. Otherwise i.e. 
scc{w) is not trivial, the move M is simulated in {G, k) according to w: 

• if w G Vg' then M is simulated by the move (C, Thief, L, n) (G", Gops, L, n) where G" is the 
strongly connected component of G' containing w, 

• if w ^ Vg' then the move M is simulated by the come back move (G', Thief, L, n) — > (G^ , Gops, L' , m) 
where (G~, Gops, L' , m) d L and w € Vg- ■ 

A Cops' move of the form N = (G', Gops, L, n) — > (G' \ w. Thief, L,n — 1) in .^^(G, fc) is simulated in 
S"^ {G, k) according to the nature of the position (G', Gops, L, n). 

• if the position {G" , Thief ,L" ,n) that precedes {G' ,Gops,L,n) was in the same strongly con- 
nected component i.e. G' C G" (note that L = L"), then the move N is simulated either by 
{v,G, Vir, Gops) (w,GU {v}, Vir, Thief) if v — w, or by {v,G, Vir, Gops) {v,G,Vir \J 
{ w }, Thief) otherwise. 

• if the position (G', Gops, L, n) comes from a come back move (G", Thief, L" , m) — s- (G', Gops, L, n) 
then iV is simulated by {v,G,Vir, Gops) -> {v,G \ {G HVg-), Vir \ {Vir HVg-), Thief). 

Let us define G^. There exists just one position 7^ such that (i) 7^ has the same predecessor of 
the position {G' ,Gops, L,n) in the game ^^{G,k) and (ii) the position {G" , Thief , L" ,m) has 
been reached from the position 7^. We define G~ to be the digraph associated to 7", i.e. 7^ is 
of the form [G^ ,Gops, ,n^). 

□ 

Finally, besides Theorem lS.l) we give further conditions under which the non collapse of the variable 
hierarchy implies the non collapse of the star height hierarchy of a given /i-calculus L^. 
The proof schema of the strictness of the variable hierarchy consists essentially in the construction of 
hard /i-terms of arbitrary entanglement |6l[J. A /x-term t is said to be hard (w.r.t entanglement) if for 
every ^-term t' which is equivalent to t we have that the entanglement of t (viewed as a digraph) is 
lower or equal to the entanglement of t' up to a constant. To argue that the star height of is also 
infinite, it suffices to construct hard //-terms of arbitrary entanglement such that the entanglement of 
each /i-term equals its rank. It follows from Theorem 15 . 1 1 that such /i-terms are also hard w.r.t the star 
height. 
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